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Abstract 

Background: Cluster randomized trials (CRTs) present unique ethical challenges. In the absence of a uniform 
standard for their ethical design and conduct, problems such as variability in procedures and requirements by 
different research ethics committees will persist. We aimed to assess the need for ethics guidelines for CRTs among 
research ethics chairs internationally, investigate variability in procedures for research ethics review of CRTs within 
and among countries, and elicit research ethics chairs' perspectives on specific ethical issues in CRTs, including the 
identification of research subjects. The proper identification of research subjects is a necessary requirement in the 
research ethics review process, to help ensure, on the one hand, that subjects are protected from harm and 
exploitation, and on the other, that reviews of CRTs are completed efficiently. 

Methods: A web-based survey with closed- and open-ended questions was administered to research ethics chairs 
in Canada, the United States, and the United Kingdom. The survey presented three scenarios of CRTs involving 
cluster-level, professional-level, and individual-level interventions. For each scenario, a series of questions was posed 
with respect to the type of review required (full, expedited, or no review) and the identification of research subjects 
at cluster and individual levels. 

Results: A total of 189 (35%) of 542 chairs responded. Overall, 144 (84%, 95% CI 79 to 90%) agreed or strongly 
agreed that there is a need for ethics guidelines for CRTs and 158 (92%, 95% CI 88 to 96%) agreed or strongly 
agreed that research ethics committees could be better informed about distinct ethical issues surrounding CRTs. 
There was considerable variability among research ethics chairs with respect to the type of review required, as 
well as the identification of research subjects. The cluster-cluster and professional-cluster scenarios produced the 
most disagreement. 

Conclusions: Research ethics committees identified a clear need for ethics guidelines for CRTs and education 
about distinct ethical issues in CRTs. There is disagreement among committees, even within the same countries, 
with respect to key questions in the ethics review of CRTs. This disagreement reflects variability of opinion and 
practices pointing toward possible gaps in knowledge, and supports the need for explicit guidelines for the 
ethical conduct and review of CRTs. 
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Background 

Cluster Randomized Trials (CRTs), that is, trials in which 
the units of randomization are intact social units or 
groups, rather than independent individuals, are an in- 
creasingly common design in health research [1,2]. It is 
convenient to distinguish between three kinds of CRTs de- 
pending on the level of intervention: cluster-cluster trials 
(experimental interventions administered to the entire 
cluster as a unit), professional-cluster trials (experimental 
interventions administered to health or other profes- 
sionals), and individual-cluster trials (experimental inter- 
ventions administered to patients or individuals) [3,4]. An 
example of a cluster- cluster trial is the COMMIT study, in 
which 22 communities in the United States and Canada 
were randomized to evaluate a community-wide advertis- 
ing campaign to reduce smoking [5]. In the Nexus trial, an 
example of a professional-cluster trial, 247 primary care 
practices were randomized to evaluate the effect of audit 
and feedback and reminder messages on radiology refer- 
rals [6], while in the bed net trial, an example of an 
individual-cluster trial, 36 villages were randomized to 
evaluate the impact of distribution of insecticide -treated 
bed nets to individual citizens on malaria morbidity and 
mortality in remote areas of Cambodia [7]. 

There are many aspects of CRTs that complicate their 
ethical design, conduct and review (beyond the statistical 
complications) [3,8-10]. In the absence of guidance tai- 
lored to CRTs, researchers and research ethics committees 
have had to rely on variable interpretation of existing re- 
search ethics guidelines, which were developed primarily 
with individually randomized trials in mind. This has likely 
contributed to variation in how CRTs have been con- 
ducted in practice, as well as in the requirements and de- 
cisions by different research ethics committees [11,12]. 
Between 2008 and 2012, we conducted a mixed-methods 
research project to develop internationally accepted, prin- 
cipled guidelines for the ethical design, conduct, and re- 
view of CRTs [13]. As part of the effort to develop these 
guidelines, we conducted a web-based survey of chairs of 
research ethics committees (Research Ethics Boards 
(REBs) in Canada, Research Ethics Committees (RECs) in 
the United Kingdom, Institutional Review Boards (IRBs) 
in the United States). The main objectives of this survey 
were to a) evaluate the need among research ethics com- 
mittees for guidelines specific to CRTs, b) gather informa- 
tion about the research ethics review process for CRTs at 
their institutions, and c) elicit their views on ethical issues 
in CRTs using a scenario-based approach. 

Methods 

Target population 

The target population was chairs of research ethics com- 
mittees (one per institution) in Canada, the United 
States, and the United Kingdom that a) are currently 



active, b) review health-related human subjects (that is, 
biomedical) research, and c) review randomized con- 
trolled trials. 

Sample size 

The target sample size for the survey was 300, based on 
estimating the proportion of chairs who agree or 
strongly agree that there is a need to develop research 
ethics guidelines for CRTs. A total of 300 respondents 
would be sufficient to allow a 95% two-sided confidence 
interval to extend ± 5.7% around an expected proportion 
of 50%, which is the proportion that yields the max- 
imum width. Assuming a response rate of 50%, we antic- 
ipated that we would need to survey all REBs in Canada, 
all RECs in the United Kingdom, and a random sample 
of IRBs from the United States. Our expected sample 
sizes were therefore 90 to 100 Canadian chairs, 50 to 60 
United Kingdom chairs, and 150 to 160 United States 
chairs, for an overall total of 300 respondents. 

Sampling strategy 

Obtaining an adequate sampling frame for research eth- 
ics committees in the three countries was challenging. 
Figures 1, 2 and 3 present flow diagrams summarizing 
the identification, sampling, and participation of re- 
search ethics chairs in the United States, Canada, and 
the United Kingdom. In the United States, we used a list 
of 3,903 so-called IORGs (Institutional Review Board 
Organizations') provided by the Office of Human Re- 
search Protections (OHRP). This list did not differentiate 
between biomedical or nonbiomedical IRBs. To increase 
the efficiency of sampling, we separated the IORGs into 
two strata: the first stratum consisted of 190 IORGs suc- 
cessfully matched to the top 200 National Institutes of 
Health funded institutions [14] (and thus more likely to 
be biomedical); the second consisted of the remainder of 
the IORGs, from which we randomly sampled 210. 
Among these, we used online searches to exclude those 
that were clearly nonbiomedical. The final sample size in 
the United States was 300. 

In Canada we used a list of 252 'biomedical' REBs sup- 
plied by the National Council on Ethics in Human Re- 
search (NCEHR). As this list was approximately 10 years 
out of date, it was cross-checked against the list of 
Canadian-based IORGs provided by the OHRP to obtain 
updated contact information and to identify any add- 
itional REBs. For those REBs not on the OHRP list, we 
attempted to obtain their updated contact information 
by conducting online searches, sending an email to the 
contact on file, and making telephone calls. The final 
sample size in Canada was 195 REBs. 

In the United Kingdom, we used a list obtained from 
the National Research Ethics Service (NRES) to identify 
119 active RECs. We cross-checked this list against the 
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All lORGs in the 
United States 
N = 3903 
I 



Stratum 1 : 
Top 200 NIH-funded 
institutions 



1 



Stratum 2: 
Remainder of lORGs 
N = 3713 



All lORGs included 
N = 190 



Excluded: 

- no contact info: 2 



Random sample 
n = 210 



Surveyed 
n = 188 



Excluded: 

- Ineligible: 15 

- Undeliverable: 1 



Excluded: 

- non-biomedical: 95 

- no contact info: 3 



Surveyed 
n = 112 



Response rate: 62/172 = 36.0% 

- Declined: 6 

- No response: 104 

- Respondents: 62 



Excluded: 

- Ineligible: 12 

- Undeliverable: 6 



Response rate: 24/95 : 

- Declined: 4 

- No response: 66 

- Respondents: 24 



25.5% 



Figure 1 Flow diagram summarizing the identification and inclusion of Institutional Review Boards (IRBs) in the United States. lORGs, 
Institutional Review Board Organization; NIH, National Institutes of Health. 



United Kingdom-based IORGs on the list provided by 
the OHRP and identified an additional 36 (mostly 
university-based) RECs. The final sample size in the 
United Kingdom was 152 RECs. 

Survey questionnaire 

After pre-testing [15], the final questionnaire consisted of 
37 items and required 30 to 45 minutes to complete. The 
first section of the questionnaire presented three scenarios 
of CRT protocols that (hypothetically) had been submitted 
at the chairs institution. The scenarios are presented in 
Table 1. Briefly, the first scenario was a cluster-cluster trial 
to evaluate a mass media advertising campaign to increase 
colorectal cancer screening; the second was a professional- 
cluster trial of an educational intervention targeted at gen- 
eral practitioners (GPs) to reduce imaging for nontraumatic 
back and knee pain; the third was an individual-cluster trial 
randomizing villages in Cambodia to evaluate effectiveness 
of insecticide-treated bed nets against malaria. The ques- 
tions following each scenario addressed the type of review 
the study would undergo at their institution (full review, ex- 
pedited review, no review, or don't know) and which cluster 
members they would consider to be research subjects. 



Options for research subjects varied in each scenario from 
more inclusive (for example, all cluster members), to less 
inclusive (for example, only those who received an inter- 
vention or who participated in data collection). Open text 
boxes were provided to allow respondents to explain their 
answers. Additional questions addressed informed consent 
procedures, and benefits and harms, and will be reported 
elsewhere. The second section of the questionnaire ad- 
dressed the perceived need for ethics guidelines for CRTs 
and included space to make any other comments about 
ethical issues in CRTs. A final section requested demo- 
graphic and descriptive information. 

Survey implementation 

The survey was conducted between April and July 2011. 
A series of five contacts, based on Dillmans recommen- 
dations for the implementation of mail and internet sur- 
veys, was used [16]. An invitation was sent to the chair 
or committee contact on file including the survey URL, 
a unique password, and details of confidentiality. A 
thank you and reminder email was sent to all contacts 
1.5 weeks after the invitation, with reminder emails sent 
3 and 5 weeks after the invitation. As a special' contact 
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Canadian REBs 
List from NCEHR: N = 252 
Additional from OHRP: N = 4 



Exclude: 

-Multiple REBs from the 
same institution: 26 



Stratum 1 
No updated contact info: 
N = 126 



Stratum 2 
Updated contact info from 
OHRP: N = 104 



Established contact: 75 
-Ineligible: 24 
-Updated info: 42 
-Excluded duplicate: 8 
-Excluded pilot site: 1 

No contact: 51 



Surveyed 
n = 93 



Excluded: 

- Ineligible: 24 

- Undeliverable: 2 



Excluded: 
-Pilot site: 2 



Surveyed 
n= 102 



Response rate: 18/67 : 

- Declined: 4 

- No response: 45 

- Respondents: 18 



26.9% 



Excluded: 

- Ineligible: 15 

- Undeliverable: 1 



Response rate: 42/86 : 

- Declined: 8 

- No response: 36 

- Respondents: 42 



48.8% 



Figure 2 Flow diagram summarizing the identification and inclusion of Research Ethics Boards (REBs) in Canada. NCEHR, National 
Council on Ethics in Human Research; OHRP, Office of Human Research Protections. 



has been shown to improve overall response to mail sur- 
veys, a final reminder was sent by postal mail approximately 
8 weeks after the initial invitation. A $30 Amazon gift cer- 
tificate was offered to each respondent as an incentive. 

Data analysis 

Categorical variables were described using frequencies 
and percentages. Exact or asymptotic methods were used 
to calculate 95% confidence intervals (CIs) of percent- 
ages for the main outcomes. We conducted tests of asso- 
ciation using chi-squared or Fishers exact tests as 
appropriate. Verbatim comments from open text boxes 
were selected to illustrate the range of perspectives. 

Ethics approval 

Participants were informed that participation is voluntary 
and assured of the confidentiality of their responses. Sub- 
mission of the questionnaire was considered as consent. 
The study procedures were approved by the Ottawa Hos- 
pital Research Ethics Board. 



Results 

Response rates 

Of 647 contacts surveyed, 105 were discovered to be ineli- 
gible; of the remaining 542 chairs, 189 responded, giving 
an overall response rate of 35%. Response rates were 
slightly higher in Canada (39%) than in the United 
Kingdom (35%) and the United States (32%) (P = 0.36). To 
help understand why response rates were lower than 
anticipated, we compared response rates by various as- 
pects of the sampling design. First, we explored whether 
outdated contact information was a factor within Canada. 
We found that response rates were significantly higher 
among those with updated contact information from the 
OHRP list (49% versus 27%, P = 0.006). Next, we explored 
whether the inclusion of nonbiomedical committees was a 
factor within the United States. We found that response 
rates were higher among the top funded NIH institutions 
(more likely to be biomedical) (36% versus 26%, P = 0.08). 
In the United Kingdom, we compared response rates 
among university (29%) and National Research Ethics 
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United Kingdom RECs 
List from NRES: N = 119 
Additional from OHRP: N = 36 



Stratum 1: OHRP list 
N = 34 



Surveyed 
n = 34 



Excluded: 

- Multiple at one institution: 2 

- Pilot site: 1 



Stratum 2: NRES list 
N = 118 



Surveyed 
n = 118 



Excluded: 

- Ineligible: 13 

- Undeliverable: 0 



Excluded: 
— | - Ineligible: 15 
Undeliverable: 1 



Response rate: 6/21 = 28.6% Response rate: 37/102 = 36.3% 

- Declined: 4 _ Declined: 5 

- No response: 11 . No response: 60 

- Respondents: 6 - Respondents: 37 



Figure 3 Flow diagram summarizing the identification and inclusion of Research Ethics Committees (RECs) in the United Kingdom. 

NRES, National Research Ethics Service; OHRP, Office of Human Research Protections. 



Service committees (36%) but found no significant differ- 
ence (P = 0.50). 

Characteristics of respondents 

Table 2 presents characteristics of participating ethics 
committees and chairs in the three countries. There 
were some notable differences among countries: partici- 
pating committees in the United States tended to be in 
existence longer than those in the United Kingdom (85% 
established before 1990 in the United States versus only 
27% in the United Kingdom). Respondents in the United 
States reviewed a median of 30 protocols per month, 
compared to 5 and 8 in Canada and the United Kingdom 
respectively. Approximately two-thirds of respondents in 
Canada and the United Kingdom reported that they 
reviewed at least one CRT per year, compared to 92% of 
respondents in the United States. Only three committees 
(all in the US) indicated that they had guidelines in place 
for CRTs, and only eight in total indicated that they were 
aware of any guidelines for CRTs. 



Perceived need for guidelines 

Table 3 presents respondents' perceived need for ethics 
guidelines. Overall, 144 chairs (84%, 95% CI 79 to 90%) 
agreed or strongly agreed that there is a need for ethics 
guidelines for CRTs, 158 (92%, 95% CI 88 to 96%) that re- 
search ethics committees could be better informed about 
distinct ethical issues surrounding CRTs, and 52 (31%, 95% 
CI 24 to 38%) that ethics application forms ought to be de- 
signed separately for the CRT design. These responses were 
not significantly different among the three countries (re- 
sults not shown). They were also not significantly associ- 
ated with experience reviewing CRTs: agreement with the 
need for guidelines was 84% versus 85% (P = 0.82), and 
agreement that committees could be better informed 98% 
versus 91% (P = 0.10) among committees with and without 
prior experience reviewing CRTs, respectively. 

Types of review required for each scenario 

Figure 4 presents the type of review that would be re- 
quired for each scenario. There was large variability 
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Table 1 Description of three scenarios of cluster randomized trials presented in survey 

Scenario Description 

Cluster-cluster trial (mass media advertising for A researcher at your institution is proposing a cluster randomized trial to evaluate a radio, 
colorectal cancer screening) television, and billboard advertising campaign aimed at increasing the proportion of 

community residents who receive colorectal cancer screening according to well-accepted 
national guidelines. Cluster randomization is used because the intervention (the advertising 
campaign) is delivered to the community as a whole. Twenty cities will be randomly assigned 
to either the intervention group or a control group receiving no intervention. A random 
sample of 500 residents in each city will be surveyed before the intervention, and a separate 
random sample of 500 residents in each city will be surveyed after the intervention, to 
determine the proportions that have been screened. The surveys will be conducted by 
telephone using random digit dialing. No personally identifying information will be collected 
in the surveys. 

Professional-cluster trial (professional education A researcher at your institution is proposing a cluster randomized trial to evaluate an 
to reduce imaging) educational intervention designed to reduce unnecessary requests for X-rays in accordance 

with well-accepted national guidelines (which have been widely available for two years) for 
patients with nontraumatic back and knee pain. All 250 general practices in the study area will 
be randomly assigned to either the educational intervention or a control group. The guidelines 
will be mailed to all general practitioners (GPs) in intervention and control practices, but 
intervention GPs will additionally receive regular reminder messages about the guidelines 
by mail, as well as feedback about the number of X-rays ordered by their whole practice 
compared with requests made by all GPs in the study. Study outcome 1 is the number of 
X-rays ordered per thousand patients using data routinely collected by radiology departments. 
These data will be sent to the researchers with GP identifiers included, to allow the researchers 
to prepare feedback to the practices about their number of X-ray requests. Study outcome 2 
is the percentage of X-ray requests that are concordant with the guidelines, determined by 
researchers reviewing and collecting anonymized data from a randomly chosen subset of 100 
patient records per practice. 

A researcher at your institution is proposing a cluster randomized trial to evaluate a malaria 
prevention intervention. Thirty villages in Cambodia with a total population of 10,000 will be 
randomly assigned to either an intervention group in which insecticide-treated bed nets will 
be distributed to all residents (by delivering them to each household), or a control group in 
which no bed nets will be distributed to any residents. Cluster randomization is used because 
the bed nets can only be effective in preventing the spread of malaria if they are used by the 
majority of residents in a village and because the investigators feel that it would not be 
acceptable to distribute bed nets to only a random half of the residents in a village. Although 
insecticide-treated bed nets have previously been shown to be effective against malaria in 
most tropical and subtropical regions, there are differences in vector biting cycles and malaria 
epidemiology in South East Asia that raise questions about the effectiveness of the insecticide- 
treated bed nets in Cambodia. Village volunteers in both intervention and control villages will 
be trained to recognize malaria symptoms and administer standard anti-malarial treatment. 
Villagers will be told that they can consult the village malaria worker when unwell. Malaria 
prevalence will be determined before and after the intervention using blood tests from 
cross-sectional random samples of 250 people per village. 



Individual-cluster trial (distribution of bed nets 
against malaria) 



among respondents in two of the three scenarios. In par- 
ticular, for the cluster-cluster (mass media campaign to 
increase colorectal cancer screening) and professional- 
cluster (education of GPs to reduce imaging) scenarios, 
approximately half of respondents indicated that these 
studies would need to undergo full review. This variability 
persisted even within countries: for the cluster-cluster sce- 
nario, the percentages indicating full review in Canada, 
the United Kingdom and the United States were 55%, 
57%, and 42%, respectively, and for the professional- 
cluster scenario, 65%, 51%, and 48%. On the other hand, 
respondents were largely in agreement in the individual- 
cluster scenario (bed nets to prevent malaria), with 86% of 
respondents indicating that a full review would be re- 
quired (88%, 87% and 85% in Canada, the United Kingdom, 
and the United States, respectively). Respondents were 
asked to explain their answers and selected explanations in 
support of each type of review are presented in Tables 4 



and 5, by country, for the cluster-cluster and professional- 
cluster scenarios. These responses illustrate the diversity of 
views even within the same countries. 

Identification of research subjects 

The identification of research subjects is presented in 
Table 6, sorted from most to least inclusive. In the cluster- 
cluster scenario (mass media campaign to increase colorec- 
tal cancer screening), there was considerable uncertainty as 
to who would be considered research subjects. Although 
the vast majority classified participants in the telephone 
surveys as research subjects, there was uncertainty whether 
all residents, only those exposed to the advertisements, or 
only those screened were research subjects. Fewer than 
one-third of respondents said that they would consider 
all city residents (intervention and control arms) to be 
research subjects. A selection of verbatim quotes sup- 
porting more inclusive views is: 
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Table 2 Characteristics of participating ethics committees and chairs 



Canada 
(N = 60) 



United States 
(N = 86) 



United Kingdom 
(N = 43) 



Total 

(N = 189) 



Response rate 

Ethics committee characteristics 
Year established 

<1990 

1990 to 1999 
> = 2000 

# Protocols/month (Median, Q1-Q3) 
Type of committee 6 

University 

Hospital/healthcare 

National Research Ethics Service 

Other nonprofit 

Other for-profit 

Number of CRTs /year 

None 

1 to 5 
>5 

Have guidelines in place for CRTs 
Aware of guidelines for CRTs 
Ethics Chair characteristics 
Years experience as chair 

<2 

2 to 5 

>5 

Years experience as member 

<6 

6 to 10 
>10 

Highest degrees c 

Doctorate 

Medical 

Masters 

Undergraduate 



39.2% (60/153) 



23 (42.6) a 
14 (25.9) 

17 (31.5) 

5 (3 to 20) 

18 (30.0) 
41 (68.3) 

2 (3.33) 
5 (8.3) 

18 (32.7) 
35 (63.6) 
2 (3.6) 
0 

1 (1.8) 



9 (16.4) 
27 (49.1) 
19 (34.5) 

26 (47.3) 
18 (32.7) 
1 1 (20.0) 

24 (43.6) 
23 (41.8) 
16 (29.1) 
4 (7.3) 



32.3% (86/266) 



66 (84.6) 
9(11.5) 
3 (3.9) 

30 (10 to 60) 

49 (57.0) 
41 (47.7) 

9 (10.5) 

2 (2.3) 

3 (8.1) 
28 (75.7) 
6 (16.2) 
3 (3.8) 

3 (3.8) 



12 (15.2) 
28 (35.4) 
39 (49.3) 

24 (30.4) 
21 (26.6) 
34 (43.0) 

36 (45.0) 
43 (53.8) 
10 (12.5) 
4 (10.8) 



35.0% (43/123) 



10 (27.0) 

13 (35.1) 

14 (37.8) 
8 (7 to 8) 

8 (18.6) 

31 (72.1) 

0 

0 

27 (34.6) 
38 (48.7) 
13 (16.7) 
0 

4 (10.8) 



9 (24.3) 

12 (32.4) 
16 (43.2) 

13 (35.1) 

16 (43.2) 
8 (21.6) 

1 7 (46.0) 
13 (35.1) 
1 1 (29.7) 
2 (2.5) 



34.9% (189/542) 



99 (58.6) 
36 (21.3) 
34 (20.1) 

10 (5 to 37.5) 

75 (39.7) 
82 (56.2) 
31 (16.0) 

1 1 (5.8) 

7 (3.7) 

48 (28.2) 
101 (59.4) 
21 (12.3) 
3(1.7) 

8 (4.7) 



30 (17.5) 
67 (39.2) 
74 (43.3) 

63 (36.8) 
55 (32.2) 
53 (31.0) 

77 (44.8) 
79 (45.9) 
37 (21.5) 
10 (5.8) 



a Table entries represent number (%) unless otherwise indicated. 
b A committee can be classified as more than one type. 
C A chair can indicate more than one degree. 
CRT, cluster randomized trial. 



Table 3 Need for ethics guidelines for cluster randomized trials (CRTs): number (%) agreeing or strongly agreeing 
with each statement 





Canada 


United States 


United Kingdom 


Total 




(N = 55) 


(N = 79) 


(N = 37) 


(N = 175) 


There is a need to develop ethics guidelines for CRTs 


45 (81.8) 


67 (84.8) 


32 (86.5) 


144 (84.2) 


Ethics committees need more information about ethical issues in CRTs 


52 (94.6) 


73 (92.4) 


33 (89.2) 


158 (92.4) 


Application forms ought to be designed separately for CRTs 


19 (35.2) 


24 (30.8) 


9 (24.3) 


52 (30.8) 
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1. Canada: They are all involved. The degree of 
protections required depends on the protocol itself, 
potential harms or burdens, potential benefits, what 
would happen anyway and what happens specifically 
because of the research. All this will vary. 

2. United Kingdom: The intervention is targeted at the 
entire community, not only those who undergo 
screening. 

3. United States: All residents in the intervention cities 
are potentially exposed to effects in the information 
campaign, and thus should be protected from effects 
of inappropriate content, no matter whether they 
actually were exposed to the advertisements. (For 
example, a spouse might hear the advertisement and 
prompt the other spouse to schedule screening.) 

Examples of less inclusive views are: 

1. Canada: No data is collected from all residents, only 
those sampled. Advertising for clinical procedures 
with or without generic advice is a normal 
experience of everyday life. 

2. United Kingdom: The intervention is the advertising 
so those not exposed and not questioned are no 
different to those citizens in any uninvolved city. 
The screening itself is not research;- it is a standard 
health process which a proportion of citizens would 
choose to undergo regardless. 

3. United States: The entire population cannot be 
considered as research subjects, both from a 
practical and study design perspective. Some may be 
affected by the advertising, but there are myriad 
ways for individuals to encounter similar messages 



and it would be virtually impossible to know what 
influenced their ultimate behavior. The residents 
who are directly contacted can more legitimately be 
considered as 'research' subjects, given their direct 
participation in the survey instruments. 

In the professional-cluster scenario (GP education to 
reduce imaging), there was a similar degree of uncer- 
tainty. Approximately two-thirds of respondents indi- 
cated that they would consider GPs to be research 
subjects (intervention and control arms). Nearly two- 
thirds indicated that patients whose medical records are 
reviewed and nearly 40% that patients whose aggregated 
data are used to calculate imaging rates are research 
subjects; fewer than one-quarter indicated that they 
would consider all patients as research subjects. A selec- 
tion of illustrative quotes that support more inclusive 
views are: 

1. Canada: All GPs in the intervention and control 
practices even if their own habits aren't being 
collected, because results will reflect on the quality 
of the practice in general and thus may impact on 
all of the GPs practicing in that practice. 

2. United States: Would be concerned about whether 
study would have an impact on ordering of x-rays 
overall, so even patients who present with other 
than back or knee pain could be affected. 

3. United Kingdom: Even if anonymised aggregated 
data is collected technically the patients are 
research subjects and the ethics committees are 
acting on their behalf to protect the appropriate 
use of their data. 
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Table 4 Illustrative verbatim explanations for the type of review required, by country: cluster-cluster scenario 



Country 



Type of review 



Explanation 



Canada 



Full review 



Expedited 



No review 



United Kingdom 



Full review 



Expedited review 



United States 



No review 

Full review 
Expedited review 

No review 



Full Board review would be recommended for the following reasons: a) community 
consent versus individual consent, b) there is an element of deception, c) the 
treatment/intervention received is determined by randomization, d) the telephone 
surveys deal with potentially sensitive topic (colorectal screening) and could result in 
situations where there is a need for follow-up medical and/or psychological care. 

Review is necessary due to 'research' component and to ensure privacy and patient 
rights are protected. Expedited as there is no experimental manoeuvre, screening 
is according to national guidelines. 

The researcher is outside our jurisdiction - They are using subjects who are unlikely 
to be our patients. At the beginning, consent is not required except at the municipal 
level. There is no financial liability to the hospital. There is no treatment intervention. 
I see this as no different from the telephone surveys I receive now at home. It would 
be polite and professionally correct to bring this to the ethics committee as an FYI. 
If the researcher wanted to add gravitas to his/her survey they might ask for the 
'blessing' of the ethics committee. However , as before, it not being done on hospital 
property, involves no patients and no therapeutic intervention. 

The exceptions are minimal risk studies with small numbers of participants, which 
have no contentious issues. In this case, 1,000 participants, approached by random 
'cold-call' telephone with verbal consent required and no prior information, would 
be rated by us as large and potentially contentious. 

The proposed trial deals with a situation where the normal practice is 'no intervention'; 
there's no specific bowel screening promotion as described in the UK. Expedited review 
would be to address whether the materials provided to the Mayors/Officials of the cities 
involved enough information to understand the proposed research. There is low/no risk 
to participating citizens and the interventions would be considered 'light touch' and of 
low risk; unless of course review of the proposed telephone interview guidelines revealed 
significant intrusive or alarming questions. 

Because it is the effectiveness of the advertising campaign that is to be evaluated and 
this in itself is not a medical intervention and I would regard the study as in support of 
delivering an established standard of normal care. 

I think the questions raised by the methodology, in particular the randomization to a community 
intervention without individual consent, would merit consideration by the full board. 

The study as described presents no more than minimal risk to the sample involved. 
The dependent measure is related to behavior. The study is not inviting participants to get 
a colorectal exam offered by the investigators. The study measures are related to the 
effectiveness of an information campaign. 

This is a survey, should be exempt 45 CFR 46.101 #2. 



Examples of less inclusive views are: 

1. United Kingdom: This trial is concerned with GPs - 
the aim is simple - if given feedback will GPs reduce 
the number of X ray requests - patients are not sub- 
jects - they are just a source of data. 

2. United States: The patients are not having an 
intervention performed on them directly and are 
therefore not research subjects. The physicians are 
being active participants and are therefore research 
subjects. 

In the individual-cluster scenario (bed nets to prevent 
malaria) there was much less variability. Almost all 
chairs indicated that residents who provided blood sam- 
ples (98%), and the majority of those who received bed 
nets (88%), would be considered research subjects. A 
slightly lower percentage (80%) would also consider resi- 
dents in control communities (not receiving bed nets) to 



be research subjects. Approximately 40% included village 
malaria workers as research subjects. 

Any other comments 

Several respondents identified a concern with respect to 
cluster-level interventions that may be considered as ex- 
perimental interventions at the individual level; they 
were concerned that such studies may lack an appropri- 
ate rationale for the adoption of the CRT design, and 
that it may be an attempt by researchers to sidestep con- 
ventional informed consent requirements. These con- 
cerns are included below as verbatim quotes: 

1. Canada: Occasionally I have been aware of cluster 
trials that deal with the evaluation of different forms 
of practice that are currently being done and for 
which there are no current standards of care 
proscribed. For example, use of different sets of 
antibiotics after cardiac interventions or changes in 
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Table 5 Illustrative verbatim explanations for the type of review required, by country: professional-cluster scenario 



Country 



Type of review Explanation 



Canada 



United Kingdom 



United States 



Full review This study would require REB approval because there is an intervention, patient data is collected 

and consent is not planned. There is the onus to review fully given the lack of a consent process, 
regardless of the reason. 

Expedited Meets all Tri-Council Policy Statement (TCPS) criteria for minimal risk. 

No review This seems to be more akin to a Quality Improvement study of whether an educational intervention 

and reminders about an accepted Clinical Guideline leads to greater acceptance and adoption of 
these practices. Our REB does not review these, but there is a process of review and support for these 
studies through our Quality and Risk Management Dept. All interventions and practices are clinically 
indicated and data is only aggregate. 

Full review Because of the randomisation of practices. Otherwise could have been considered as a service evaluation 

and therefore not require review (potentially!) 

Expedited review Minimal risk, using routinely collected data, assuming that patient data for outcome 2 are properly 
anonymised and secure, and do not require information that is outside normal clinical care. 

No review This is classic improvement methodology and would not need review. 

Full review There is an issue of physicians being known to the researchers and the potential for data about their 

behavior that could be used to potentially harm the physician's reputation due to information about 
his/her medical practices (x-rays). 

Expedited review We would not consider an educational intervention as treatment. The educational intervention mailing 
established imaging guidelines is clearly minimal risk. Measuring radiology imaging by GP is not private 
information and routinely measured by many external entities. The outcome measures of number 
X-rays/thousand and anonymized medical records review would meet Expedited review categories. 

No review This seem to be primarily a trial to determine quality of care and use or misuse of diagnostic studies. 

No patient is harmed or helped by the study. It may help cost containment. It doesn't need to come 
to the IRB. 



feeding in ICUs. What has been questioned are the 
following: What really constitutes an intervention 
(using (Tri-Council Policy Statement) as a guide) 
and therefore when should consent be obtained; 
where would one draw the line between quality 
assurance and research? Concern has also been 
raised about whether the trend for cluster trials is a 
mechanism to avoid the rigors of the consent 
process. Are letters of information sufficient to 
address this concern. These issues relate not so 
much to the large population studies, but rather to 
cluster trials being conducted in the current health 
care settings. 

2. Canada: Most of the discussions we have had when 
discussing cluster RCT centered around the 
informed consent issues, when to waive consent, 
how much information to reveal, how much choice 
is there when the whole institute is already 
randomized to a certain intervention or not, and 
how to address situations where it is not beneficial 
for certain patients to be enrolled in the wrong 
intervention for their situation. For example, in a 
hospital cluster RCT where one hospital is 
randomized to a certain surgical process while the 
other is not, patients who are contraindicated to 
that surgery who end up in the intervention arm 
should be given the opportunity to refuse 
participation. In which case, they may have to be 
referred to another hospital not in the study. 



Another identified concern was determining whether a 
study constitutes research as opposed to program evalu- 
ation or quality improvement: 

1. United States: We have struggled with many issues 
related to this- when the Ministry of a country plans 
a roll out of a public health intervention and the re- 
search is to perform a cluster analysis of the inter- 
vention, what is research, what is a public health 
program evaluation and similar issues. This is still a 
topic of discussion and debate, especially between 
the IRB and international researchers. 

Discussion 

This survey was conducted as part of a five-year project 
studying ethical issues in CRTs [13]. Following a series of 
empirical studies (including this survey), an in-depth eth- 
ical analysis, and an extensive consensus process, the 
Ottawa Statement — the first comprehensive ethics guide- 
lines specific to CRTs — was published in November 2012 
[17]. Although the survey was fielded before development 
of the Ottawa Statement, it is informative to interpret the 
results of the survey in light of the recommendations in 
the Ottawa Statement. 

The first aim of the survey was to determine the need 
for research ethics guidelines for CRTs among research 
ethics chairs internationally. We found that 84% of re- 
search ethics chairs overall recognized the need for eth- 
ics guidelines for CRTs and 92% the need for education 
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Table 6 Identification of research subjects in the cluster-cluster, professional-cluster, and individual-cluster trial 
scenarios 



Frequency (%) 



Cluster-cluster trial 


Yes 


No 


All city residents in the intervention arm 


50 (29.8) a 


118 (70.2) 


All city residents in the control arm 


46 (27.9) a 


119 (72.1) 


Residents exposed to the advertisements 


68 (39.5) a 


104 (60.5) 


Residents in intervention arm receiving screening 


72 (42.1 ) a 


99 (57.9) 


Residents participating in the telephone survey 


171 (90.0) a 


19 (10.0) 


Professional-cluster trial 


Yes 


No 


Potient-level: 






All patients in the practices 


37 (22.6) 


127 (77.4) a 


Patients presenting with back or knee pain 


63 (38.4) 


101 (61.6) a 


Patients providing data for study outcome 1 


64 (38.6) 


102 (61.5) a 


Patients providing data for study outcome 2 


104 (62.3) a 


63 (37.7) 


Professional-level: 






All GPs in intervention practices 


109 (66.9) a 


54 (33.1) 


All GPs in control practices 


103 (63.6) a 


59 (36.4) 


GPs whose patients present with back or knee pain 


127 (77.4) a 


37 (22.6) 


Individual-cluster trial 


Yes 


No 


Residents receiving bed nets 


158 (88.3) a 


21 (11.7) 


Residents in control arm receiving no bed nets 


139 (79.9) a 


35 (20.1) 


Residents providing blood samples 


1 77 (98.3) a 


3(1.7) 


Village malaria workers 


58 (36.7) 


100 (63.3) a 



'Indicates that an answer is in agreement with the Ottawa Statement. GPs, general practitioners. 



of ethics committees about ethical issues in CRTs. The 
perceived need for guidelines was not significantly asso- 
ciated with experience reviewing CRTs, which suggests 
that the need remains widespread and is not declining 
with experience. In our survey of 182 trialists (authors of 
CRTs) conducted as part of the five-year project, 74% 
(95% CI 67 to 80%) agreed or strongly agreed that there 
is a need to develop ethics guidelines for CRTs and 70% 
(95% CI 63 to 77%) that ethics committees could be bet- 
ter informed about distinct ethical issues surrounding 
CRTs [12]. Surprisingly, the proportions of research eth- 
ics chairs indicating the need for ethics guidelines were 
higher than the corresponding proportions of trialists. 

Our second aim was to investigate research ethics re- 
view procedures for three different kinds of CRTs. We 
found that there was little agreement among committees 
in the type of ethics reviews required in the cluster- 
cluster and professional-cluster scenarios, both among 
and within countries. Whereas regulatory differences 
may explain differences among countries, it does not 
explain within-country variability. Whereas there was 
more agreement in the individual-cluster scenario, clus- 
ter-cluster trials and professional-cluster trials often 
evaluate public health programs or quality improvement 



initiatives, and it is not always clear if such trials ought 
to be considered research and undergo research ethics 
review. According to Recommendation 1 in the Ottawa 
Statement, all CRTs involving human research partici- 
pants must be submitted to a research ethics committee. 
This includes CRTs evaluating quality improvement and 
knowledge translation interventions, and those in educa- 
tion or public health research. The type of ethics review 
is subject to the discretion of the committee; research 
ethics committees ought to undertake a proportional ap- 
proach to the review of study protocols such that CRTs that 
pose substantial risk or involve vulnerable participants 
ought to receive intensive scrutiny, whereas CRTs that pose 
low risk and do not involve vulnerable participants may be 
eligible for an expedited or delegated review. Although the 
majority of respondents in all three scenarios agreed that 
some type of review is required (as opposed to no review), 
variability in the type of review required is an important 
finding as it reflects fundamental differences among com- 
mittees with respect to the perceived level of risk associated 
with each scenario and the perceived vulnerability of those 
who might be considered participants. The type of review 
may have implications with respect to the level of scrutiny 
a protocol will receive during the review process, the 
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number of reviewers assessing a protocol, and the time re- 
quired to complete the review process. 

Our third aim was to characterize the views of re- 
search ethics chairs on the identification of research sub- 
jects. The proper identification of research subjects is of 
considerable importance, as only those cluster members 
who are research subjects properly fall under the protec- 
tion of research ethics committees and the regulations 
under which they operate. We observed substantial vari- 
ability among chairs in all three countries with respect 
to the identification of research subjects in the cluster- 
cluster and professional-cluster scenarios. The individ- 
ual-cluster scenario, which most resembles a standard 
randomized controlled trial, presented less disagreement. 
According to the Ottawa Statement [17,18] a research 
participant is defined as any individual whose interests 
may be affected as a result of study interventions or data 
collection procedures; that is, any individual who is the 
recipient or the direct target of a study intervention 
(whether an individual level or cluster level interven- 
tion), with whom researchers interact for study pur- 
poses, or about whom identifiable private information is 
collected. In the cluster-cluster scenario, fewer than one- 
third of chairs would consider residents in intervention 
and control communities to be research subjects, even 
though study interventions are targeted at them. It is a 
unique characteristic of CRTs that there can be partici- 
pants at both individual and cluster levels. Surprisingly, 
in agreement with the Ottawa Statement, two-thirds of 
chairs indicated that they would consider health profes- 
sionals to be research subjects. On the other hand, 
nearly 40% would consider patients whose health profes- 
sionals participate in a knowledge translation interven- 
tion and who contribute only aggregate data (that is, 
practice-level imaging rates) to be research subjects. It 
is possible that those respondents who were broadly in- 
clusive in identifying individuals who may be subjects 
in a CRT were doing so because they believed that the 
study required full ethics review and this would be one 
way to that end. Furthermore, although the need to 
seek informed consent is a separable issue [19], it is 
possible that chairs conflated the identification of re- 
search participants with the need to seek informed 
consent. The Ottawa Statement may help to avoid 
conceptual confusion by providing clarity on these im- 
portant questions. 

To the best of our knowledge, this is the first study to 
compare deliberations and decisions among research 
ethics committees in the review of CRTs. Although the 
scenarios were hypothetical, they represent three com- 
mon settings where CRTs are used and are based on 
published CRTs. Participants in our survey provided per- 
spectives from chairs in three countries: Canada, the 
United States, and the United Kingdom, and represented 



a variety of institutions: universities, hospitals, non- 
profit and for-profit, and varying degrees of experience. 
Our study provides empirical data of variability among 
committees both within and among countries in key de- 
cisions about the ethics review and conduct of CRTs. Al- 
though variability among ethics committees is not 
necessary morally problematic [20], these decisions have 
clear repercussions for the ability of research ethics 
committees to fulfill their purpose which includes pro- 
tecting the rights and wellbeing of all research partici- 
pants and to provide independent, competent, and 
timely review of the ethics of proposed studies [21]. 

Our study has two main limitations. First, our re- 
sponse rate was low and results may therefore not be 
representative. There can be many reasons for the low 
response. One is that our sampling frame was imperfect. 
Despite our best efforts at obtaining updated contact in- 
formation and screening out ineligible committees prior 
to sampling, 105 of the 647 sampled committees (16%) 
either indicated that they were ineligible (that is, were 
nonbiomedical or did not review randomized controlled 
trials) or had invalid email addresses. Our stated re- 
sponse rate is conservatively calculated, meaning that all 
non-respondents are assumed to be eligible and included 
in the denominator of the response rate. The type of 
contact information varied: in some cases we had an 
email address for a named chair, while for others, only a 
central contact was available. Our analyses of response 
rates showed that response rates were higher among com- 
mittees with more recent contact information; it was also 
higher among committees at NIH-funded institutions 
(more likely to be biomedical). Finally, our survey was rela- 
tively long and presented three complex scenarios; research 
ethics chairs are busy professionals and may simply not 
have had the time to complete the survey. Although 
we do not have any information that would allow us to 
investigate differences between respondents and non- 
respondents, we have no reason to expect answers of 
non-respondents to differ substantially from those 
observed in this survey. 

A second limitation is that the descriptions of the sce- 
narios were necessarily brief. In practice, ethics commit- 
tees would have access to the full study protocol. It is 
possible that at least some of the variability observed is 
due to the lack of clarity or incompleteness of the infor- 
mation provided. However, we believe that the most 
relevant information was presented in each scenario, 
and the results are in line with findings from our survey 
of CRT investigators, which suggested that there are 
substantial challenges in practice. We were pleasantly 
surprised by the level of detail and thoughtfulness put 
into the open text responses. It was apparent that the 
majority of respondents paid careful consideration to the 
details provided in the scenarios and presented well- 
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articulated and clear responses. This suggests that re- 
spondents understood that the scenarios were intended 
to trigger reflection on a certain class of study, rather 
than limit their consideration to those details provided 
in the survey alone. 

Conclusions 

CRTs are an important research design, but research 
ethics committees and investigators need guidance as to 
ethically appropriate practices. Our scenario-based sur- 
vey provides empirical evidence of the likely variability 
of opinion and practices within and among countries, 
pointing towards possible gaps in knowledge, and fur- 
ther supporting the need for guidelines. 
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